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ROBOT SYSTEM EQUIPPED WITH A TOOL, CAMERA 

AND LIGHT SOURCE 

Cross-Reference to Related Application 

[0001] This application is a national stage of PCT/EP20005/000241 filed January 

13, 2005 and based upon DE 10 2004 005 574.2 filed February 5, 2004 under the 
International Convention. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to a robot system that is provided with a light 

source and a camera for detecting geometric properties of a workpiece, and at least one 
tool in order to perform manipulations on the workpiece. Such a robot system is 
disclosed, for example, in JP-A-07-28 68 20. 

Description of the Related Art 

[0003] In this known robot system, a light course and a camera are mounted in 

conmion, but independently of a tool, at the tip of an articulated robot arm and can be 
positioned in space with a pluraUty of degrees of fi-eedom such that the light source 
illuminates a workpiece to be machined and the camera records pictures of the 
workpiece. 

[0004] In this known system, the camera and light source cannot be moved 

relative to one another. It is true that with the aid of a projector the hght source can 
optionally illuminate different strip-shaped zones in the field of view of the camera even 
without a movement of the light source, but the direction firom which a specific point of 
an object in the field of view is irradiated is always the same as long as the light source 
and camera do not move jointly. This can render it very difficult to evaluate the images 
recorded by the camera, particularly when the regions of an object that are of interest are 
shaded by objects situated between the hght source and them. 
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SUMMARY OF THE INVENTION 

[0005] It is an object of the invention to provide a robot system in which it is 

possible to implement optimum viewing conditions for a camera for the purpose of 
detecting a workpiece in conjimction with different geometries of the workpiece or an 
environment in which it is installed. 

[0006] The object is achieved by virtue of the fact that the light source and the 

camera can be moved independently of one another in order to illimiinate the field of 
view from different directions. That is to say, when a region of a workpiece that is of 
interest is poorly illuminated in the given position of the light source and camera with 
reference to one another, the light source can be moved independently of the camera in 
order to improve the illumination of this region. The variability of the alignment of the 
light source and camera relative to one another also faciUtates the process of obtaining 
3D information from an image recorded by the camera, since the change of the shape of 
shadows that is associated with a variation in the direction of irradiation onto an object 
permits an electronic imit for image evaluation that is possibly connected to the camera to 
distinguish shadow zones from surfaces that are intrinsically dark. 

[0007] A subassembly that comprises the camera and the light source as well as at 

least a first adjusting device for moving camera and light source relative to one another 
can preferably be moved by a second adjusting device with reference to a common base. 
Thus, for example, a standard position of the camera and light source with reference to 
one another that supplies useful images for most geometries of a workpiece to be 
examined can be set at the first adjusting device, and it is possible to operate only the 
second adjusting device in order to vary the field of view or viewing angle of the camera. 
Since this camera and hght source move jointly, apart from parallax effects the light 
source remains aligned with the field of view of the camera without the need to control 
the movement of the former expressly. 
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[0008] Of the camera and light source one is preferably firmly connected to the 

second adjusting device, such that its position and orientation is given completely and 
exclusively by the position of the second adjusting device, whereas the position of the 
light source with reference to the camera is defined by the position of the first adjusting 
device. 

[0009] Furthermore, a subassembly that comprises the camera and at least one of 

the tools as well as at least one third adjusting device for moving camera and tool relative 
to one another can be moved by a fourth adjusting device with reference to a common 
base. Here, as well, of the camera and tool in each case one is preferably firmly 
connected to the fourth adjusting device, such that its its position and orientation is given 
completely and exclusively by the position of the fourth adjusting device, and the 
position of the third adjusting device fixes the position of the camera and tool with 
reference to one another. 

[0010] The tools of the inventive robot system preferably include at least a 

gripping tool and fiirther tool for carrying out any desired machining step on the 
workpiece. The gripping tool, which is to be understood here as encompassing any 
desired tool for temporarily holding, and, if appropriate, moving a workpiece, can be 
used, in particular, for the purpose of gripping and (at least temporarily) removing 
obstacles that otherwise prevent free access of the light fi'om the light source, the view of 
the camera or the access of the further tool to a site of interest on the workpiece. 

[001 1] Whereas the mobiUty of the further tool with reference to the camera can 

be restricted, it is desirable for the gripping tool and the camera to have as high a number 
of degrees of fireedom as possible in the relative movement so that the gripping tool can 
remove obstacles without impairing the field of view of the camera. Consequently, the 
gripping tool and the camera are preferably mounted on mutually independent moveable 
carriers, in other words the number of degrees of fi'eedom with which the gripping tool 
and the camera can be moved with reference to one another is greater than the nimiber of 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] Further features and advantages of the invention emerge from the 

following description of exemplary embodiments with reference to the attached figures. 
In the drawing: 



Figure 1 shows a first exemplary embodiment of an inventive robot system 

in which a camera, light source and tool are respectively carried by 
a robot arm mounted on a stationary base; 

Figure 2 shows a modification of the robot system from figure 1 , equipped 

with two tools; 

Figure 3 shows a second refinement of a robot system equipped with two tools; 

and 

Figure 4 shows a third refinement of the robot system, in which robot arms carrying 

the camera, light source and tool are mounted on a gantry. 



DETAILED DESCRIPTION OF THE INVENTION 
[0013] Figure 1 shows a schematic of the fundamental principle of the invention. 

A stationary base 1 mounted, for example, on the floor of a workshop carries a robot arm 
2 with a number of articulated members 3. Articulations 4 between the base 1 and the 
members 3 or between two members 3 each have at least one, preferably a number of 
degrees of rotational freedom and can be driven by a control device (not illustrated) in 
order to position and to swivel a tool 5 mounted at the end of the arm 2 in all three spatial 
positions and doing so as desired within the scope of the range of the arm 2. The tool 5 
can be of any desired known suitable type of machining a workpiece 6, for example a 
gripper, a drill, a milling machine, a welding tool, etc. 

[0014] A second base 7 carries a second robot arm 8 whose design can be the 

same as that of the robot arm 2. Mounted at the free end of the robot arm 8 is a camera 9 
that can be positioned as desired in space under the control of the control device and can 
be aUgned with the workpiece 6 in order to supply images of the workpiece 6 to the 
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control device. Projecting from the camera 9 is a rail 10 on which a carriage 11 can be 
moved under the control of the control device. The carriage 11 carries a Hght source 13 
by means of a likewise controllable articulation 12. The light source 13 can be a simple 
spotlight with reflectors such as is indicated in the figure that has a cone of light, with a 
principal ray direction B, which can be aligned with the workpiece 6, by displacing the 
carriage 11 and swiveling the articulation 12, from the various angles relative to the 
direction of view of the camera 9. The rail 10 can preferably be rotated about the optical 
axis A of the camera 9 such that not only is the angle between the principal ray direction 
B of the light source 13 and the optical axis A of the camera 9 variable, but also the 
position of the plane defined by these two directions. Whilst the robot arm 8 constitutes a 
first adjusting device with which the control device can displace camera 9 and light 
source 13 in a fixed relationship to one another as regards position, the carriage 11 and 
the articulation 12 are part of a second adjusting device, which in the event of a given 
position and orientation of the camera by the illumination of the field of view of the 
camera 9 can be varied in order to find that illimiination which respectively enables 
details of the workpiece 6 that are of interest to be detected most effectively. 

[0015] A preferred development of the robot system is shown in figure 2. Parts 

of this robot system that already correspond with reference to parts described in figure 1 
bear the same reference numerals and are not described anew if there are no differences 
from the configuration of figure 1 . The free end of the robot arm 8, which carries the 
camera 9, here forms the base of a third robot arm 14 at whose free end the gripping tool 
15 is located. The gripping tool 15 can have in the usual way a niunber of fingers, that 
can be moved relative to one another, for clamping the workpiece 6 or a part thereof or, 
when the part to be gripped is ferromagnetic, it can include an electromagnet, and it can 
have a suction cup connected to a vacuum source or any other desired device for 
temporarily keeping hold of an object. When the control device identifies in the image 
supplied by the camera 9 an object that obstructs the view onto the site on the workpiece 
6 that is of interest, or which shades this site, it drives the gripping tool 15 so as to 
remove the relevant object temporarily, for example so as to push aside a hose connected 
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to the workpiece has been inspected, the plug-in connector is plugged in again by the 
gripping tool 15. 

[0016] The light source 13 is mounted here on a third stationary base 16 by means 

of a fourth robot arm 17 and, by contrast with the gripping tool 15, therefore does not 
move in a fashion coupled to the camera 9. It therefore does not restrict the mobility of 
the robot arm 14 aroimd the camera 9. Alternatively, the gripping tool 15 and the light 
source 13 could, of course, both be mounted on the robot arm 8 in a moveable fashion 
with reference to the camera 9. 

[0017] In the configuration shown in figure 3, the tool 5 and the camera 9 are 

mounted at the free end of the first robot arm 2. The camera 9 can be firmly connected to 
the tool 5 in a fashion permanently aUgned with a tip of the tool 5 that interacts with the 
workpiece. The light source 13 and the gripping tool 15, which is connected thereto via 
the robot arm 14, are arranged on the second robot arm. As long as the arm 14 is not 
moved, the gripping tool 15 follows every movement of the light source, and is thus 
always located in the vicinity of the light source where it is required in order to remove 
an obstruction between the light source and the surface, observed by the camera 9, of the 
workpiece 6 or between this surface and the camera 9. 

[0018] Figure 4 shows a schematic of a robot system in the case of which the arm 

2 carrying the tool 5, and the arm 8 carrying the camera 9 and the light source 13 are 
moimted on rails 18 of a crab 19 that for its part can move on rails 20 of a gantry 
superstructure. The design and mode of operation of the arms 2, 8 is the same here as in 
the case of figure 1. If desired, however, the number of the articulations 4 in the case of 
the arms 2, 8 of this exemplary embodiment can be reduced by comparison with figure 1 , 
since the mobility along the rails 18, 20 adds two degrees of fi-eedom to the translation. 

[0019] The robot arms could also be mounted jointly on a vehicle in accordance 

with a modification that is not shown. 
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[0020] Now that the invention has been described, We claim: 
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